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/571 A technique, specificaly apparatus and an 
accompanying method, tor accurately thresholding an 
frSgVbased on local image properties, speed caBy lumi- 
nance variations, and particularly such a techmque that 
uses multi-windowing for providing enhanced immunrty 
to image noise and lessened boundary artifacts. Specrf- 
cally a localized intensity gradient. G(i j). is determined 
fa a pre-defined window (300) centered about each 
imaoe pixel(ij). Localized minimum and maximum pixel 
Sty measures. L^and^. respectively ; are also 
determined tor another, though larger, window (330) cen- 
tered about pixel(i.j). Also, a localized area gradient 
measure. GS(ij). is determined as a sum of .'"divriua 
intensity gradients for a matrix of pixel posrt.ons (370) 
centered about pixel position (i j). Each image p.xel(i.D is 
then classified as being an object pixel. i.e.. black, or a 
background pixel, i.e. white, based upon its area gradi- 
ent. GS(ij), and associated U and L^, measures. 
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Description 

TECHNICAL FIF ' D OF THE INVENTION 

The invention relates to a technique, specHically apparatus and an accompanying method, tor accurately thresh> 
olding an image based on local image properties, specHically luminance variations, and particularly one that uses multi- 
windowing for providing enhanced immunity to image noise and lessened boundary artifacts. 

RAP.Kf^ROl JND ART 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
of printed or other textual documents are being scanned tor subsequent computerized processing of one form or another 
and/or digital transmission. This processing may involve, for example, optical character recognition, tor converting printed 
characters, whether machine printed or handwritten, from scanned bh-mapped form into an appropriate character set. 
such as ASCII, the latter being more suitable for use with word processing and similar computerized document-process- 

109 banning a gray-scale document typically yields a multi-bit, typically eight-bit value for each pixel in the scanned 
document. The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
in the document. These pixels are generated, depending upon the resolution of the scanner, frequently at resolutions 
of 200-400 pixels/inch (approximately 80-160 pixels/cm), though with highly detailed images at upwards of 1200 or more 
pixers/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 11 inch (approximately 22 by 28 cm) image 
wiO contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
characters of some sort against a contrasting colored background, typically white or black print against a white or light 
colored background, or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
that pixel is either part of a character or the background. Therefore, scanned textual images, or scanned textual portions 




distinguish the different types of scanned images, a gray-level image is defined as one having multi-bit (hence mufti- 
value) pixels, whereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen-^ 
erate considerably less data for a given textual image, such as. e.g.. one-eighth, as much as for an eight-bit gray-scale 
rendering of the same image, binary images are more efficient over corresponding gray-scale images and thus preferred 
tor storage and communication of textual images. Binary images are also preferred because of their easy compressibility 
using standard compression techniques, e.g.. CCITT Groups 3 or 4 .compression standards. 

Gray-scale images are converted to binary images through a so-called thresholding process. In essence/each mufti- 
bit pixel value in a gray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variable 
or even adaptively variable, to yield a single corresponding output bit. If the multi-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bit output pixel is set to a "one*; otherwise rf the threshold is 
greater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
extracts those pixels, such as those which form characters, or other desired objects, from the background in a scanned 
gray-scale image, with the pixels that form each character, or object, being one value, typically that tor black, and the 
pixels tor the background all being another value, typically that for white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an -object". 

Ideally the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned image and maps those pixels to a common single-bit value, such as, e.g., "one" for black. In practice, noise, 
background shading, lighting non-uniformities in a scanning process and other such phenomena, preclude the use of e 
single fixed threshold for an entire image. In that regard, if the threshold is too low, the resulting image may contain an 
excessive amount of noise in certain, rf not all regions; or. if too high, insufficient image detail, again in certain, if not all. 
regions - thereby complicating the subsequent processing of this image. Given this, the art recognizes that a preferred 
approach would be to select a different threshold value that is appropriate to each and every pixel in the scanned image. 
In doing so the proper threshold value is determined based upon local properties of the image, i.e., certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold would vary across the image, 
possibly even adapt to changing localized image conditions. 

In general, a common methodology for variable thresholding relies on measuring localized image characteristics, 
such as local intensity contrast (or gradient), local averaged intensity and/or local variance, in a local window centered 
about a pixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
ground pixels, white. Here, too, reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated by a need to extract various objects in a wide range of documents but with minimal user intervention, such 
as for purposes of initialization and object identification, and while still yielding a clean background in the thresholded 
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» .nbiects may include. e.g..d^ 
image. In reality, these objects W™™* «• • entoedded in a black background, 

such as white objects in a gray background and gray adeq uate performance with actual 
Nevertheless, given the overwhelms inability of that attempt to provide satisfactory 

J£SL art has persisted by '-chi^severa ^S^SSSS^ in pretend to MM utinty. 
oSormance. However, all these approaches sutlertom one a properties, are taught in M. Kamel et 
' Cous approaches ^ 

a... 'Extraction of ^ «^£*£ ^2^7 Here, a Togica. lever approach Is based.on cornpar-^a 
\™mri2&&&- ^ 5 f ' ^ "^hSorav level (H the image is noisy) with four local averages m ne.ghbc<hoods 
centered about four pixels orthogonally surrounding f ™ 9^ P ^ weaned -mask-based subtraction-, relies 

'J tour .oca. averages, tnen the J-"^^ First. mostof 

on considering every pixel m . a ^.mage as a ^ oste 8 nsibly 1onctioning * remove "particle nojse The 

the background pixels are detected using a logical rme . tc'^ / n , xe| ^ s(opes 

ImarTst^ 

of 0 n/4. n/2 and 3n/4. The lesulting tilts red Dinary .mage modified by detecting additional back- 

bac^ound pixels wh-ch are pixel, the gray level 

ground pixels using a predetermined^ ^JJ^^^bS^I^ Lastry. a grayscale charecter/graph- 
of its background image is estimated by linear ,n \ e ^^ U ^Z e {lofn the ori ginal scanned image with resulting 
£ lege I* obtained by subtracting ^^^^^^aphics irnage. Though the global threshold 
differences then being globally ^^^^^^^.^^J^ a varying background value essentia* 
value itself is fixed, basing ,h * ^^^^ approaches would appear to be somewhat immune 

dim ^^^^ZT^^ <.86B.670 (issued to R.R.A. Morton et «'-^en^r 
Another approach, as described in un "~J^ tracking a background value in an image, with a threshold 

n9 . 19 89 and ownedby the ^^^^^^TXTZa feedback signal. Here, whenever a transition 
value being a sum of a tracked background value, a noise p , e -defined pattern to momertlarly 

occus in the image, such as an edge, the m ^£S<£*U* value has a reduced noise content. 
SS the threshold value such that oste ^s,b* an , ^^ a ^ H ^t1nt P ensity transitions due to abrupt changes 

itetai Meeting low contrast objects ^ to j c Stoflel ^ e{on August 28 . 1984). 

Afurther approach is described in ^^^^^otfset potential, which is obtained on a pixel-bypixel 
Here adaptive thresholding is rmplemented bv ^'"a an ^ StaS This offset potential is used in conjunction 
baste' as afunction of white peak and blackj *> tey pot en^ls in th J^nage^i £ ^ ™ e ^ kandv8Bey poten- 
S nearest neighbor pixels to provide an updated threshoW value ,JM »• P V £ min5mufn 

ra ,ely and reliably thresholding a grayscale image to locate ^ ^ artifacte ; as we „ as 

Es^c^ 

W e Have substantially end advantageously overcorne the def Ancles in the art through our 
"tp^K^ 

, scanned grayscale bit-mapped image. Th,s gradient <^'™f** • ~ a e detecled ^ an N-by-N pixel window 
aoout pixe.(i j). Next, minimum intercity. J^^^i^,. GS(i j) being a sum of individua. intensity 
centered over the image about p.xel(.j). In addit on. a 'ocanreo _g centered about position f.j). 

^nts.isascerta^ ^ ^ primari)y based 

Each pixelOJ) is then dassrfied as being an ob fee* pixel. ^"^^ ^ ^ ^es. These three parameters are 
anon Ss area gradient. GS(iJ). and secondanly upon [*^*£^*^^w^nr*o»s. one tor determining 
deTerr^nedfor eachand every pixelOJ) ' U and U« values. Once the gradient 

^TalTa^ 



strength values are 
gradient GS(i j) 
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pixel near an edge is so clashed rf the ;ES£vMto a locally Hat fieW. i.e.. of relatively constant 
^e-delined threshold value. intensKy vaJes against average intensity values 

£^ b ^ ^ - C,aSSHted * COmPafin9 ** ^ 

a predetermined intensity value. . g deteded tne area gradi ent. 

In particular, an image p*el(i j) located in a vicirmy oi w threshold. GT. Once such a pixel b 

GSO^orthatp^ 

lound. each pixel on a da ^ s«te rtfl^ej wge * fe to an average * m 

7 . pix e, window ^^^S^i^ "tetity of this latter pixel. ^ exceeds the avera 9 e intensity value 
associated Lmin ana u m** . . ol fc r i a ccHied as beina background, i.e.. white. 

of and L... then this , pa^r gr Sent threshold, such as where the N-by-N window 

Where the area gradient. GS(ij). 'o P'xeiuj; * ■«* t» classHied by simple thresholding, i.e.. thresh- 

s,ides a.ong an image "*' on Q ^ « t-W«-. v— of pixel(i.DJs 

SanK^ 

aTpartd the ^0 roo ^;X e doing so further increase thresholding accuracy, the intenshy values of those Pixete 
To enhance image edges and Dy 00 black pixcls are illustratively represented by a value of zero 

near an edge are ^ed. Fa the having an intensity 

and white pixels by a value of 1 w Sp ^ rf '^ y ^^,l5v of each of these pixels is reduced to a value slightly below 
value that exceeds the threshold value. IT. *e P ete> located on a brighter side of an edge 

th,esho,d.T.e.g..toava.ue^ 

and having an intensity value .ess J£ ^fmlge can then be pioduced by merely thresholding the resufcng 

' i _ «• i ii...»k A IH imIiia IT 
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old value IT e g., to vaiue ■ ■ ^- r * ■ ■ i * it 

aray-scale image against pre-defined threshold ^ n. Qrad ients. the present invention signif wanBy reduces 

9 "Advantageously, through the use ^^^SSS!SSS^S« ***** in 8 •»•*«*» image. The 
bofrba^rc^^^^^ 

oripp nESCRIPIl QbLSEIt jF PRAWIN<3S 
in conjunction whh the accompanying drawings. ,n wh.ch: 
invention; 

PIQ 2 depicts the correct alignment of the drawing sheets tor FIGs. 2A and 2B; 
F1G6 2A arxt 2B collecuvely depict a high,eve. ftowchart o^ 

FlG3 Ad^sa3^-tnx^ 
operator, gradient strength lor current pixelfij); 

3B depicts a gra phica. representation o. an N-by-N neighborhood of pixels centered about a cunent pixe.f, j) 
in an image intensity record; 

(i J) in an i"»9e inMnrty t'" 1 "" 1 ,ec< * ,; 

PIG 4 g , ap hica..y depicts intensity profile 400 of an i,.ustra«ve scan line of an original grayscale image, such as 
thTt illustratively on document 10 shown in FIG. 1 : 

PIG 5 graphica-ly depicts a modHied Intensity profile whi* resu,ts after ^resho^ing intensity profile 400 shown ^ 
TO. 4 adding to the teachings of our present invention; 

FIG. 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG. 7 depicts a block diagram ol Sum of Gradients Circuit 620 which lorms part of circuit 600 shown in FIG. 6; and 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. 

To facilitate understanding, identical reference numerate have been used, where possible, to denote identical ele- 
ments that are common to various f igures. 

MQQEg nP G&BBS1N6 gj EE THE INVENTION 

A«Pr readino the following description, those skilled in the art will quickly realize that our invention is applicable tor 
ILllT™ diument imaging system for accurately thresholding scanned documentary .mages conta.n,ng One 
use .n nearly JJ^JJJ^M * * tne media upon which the image originally appears. For example. 

Z ™ wnidiscuss our invention in ,he context of use in IhreshoW^ scanned character data, such 

-ZZ SSSSd numbers, which we will collectively refer to hereinafter as "objects- 

VcTou^rt illustration and discussion, we define black and white grayscale pxete ^^^rt 0 ray- 
. LS-?and "255". respectively. For consistency, we also define output binary pixels wrthl black being "0 and 

S ^ e ^na-rC.ea^yo!»inventive method 

^uaS that clon^a re pixel intensities, as would be readily apparent to those skilled in the art. reversed from those 

^G^ctTat'igh-leve. block diagram of document imaging system 5 that embodies the teachings of our present 
FIG. 1 depicts a n '9 n ' « , scanner 20. digital image processor 30 and "simple* thresholding 

invention. As ^^Z^O^J^^^ of interest is'scanned by scanner 20 to produce mufti- 
circuH 40. in operation^ documerrt ""J*^ data. L This data is routed, via leads 25. to a data input of digital 
bit. typically ■£2TJ3?nd?2S^ relevant here, thresholds the scanned image data and generates both 
^l^^^T^oecnZtis 37 and an output binary image on leads 33. The modified gray-scale image, as 
a ^^^•^^ZZ»^ZZ^JB^ced by processor 30 to subsequently increase thresholding accu- 
d£5 ^Sr^S^a te 1SS on lea* 37 is routed to an input of thresholding circuit 40wniJ_ 
racy. The modrfied gray ^scaie (image oa app^ * pre -defmed fixed threshold value thereby 

provding ™%SJE!o*« binary image. Digital image processor 30 performs thresholding ,n accordance wrth our 
via leads 45. an °** r °^ WQh da ( a lhr o UQhp u, s required for processing bit-mapped images, processor 30 is prefer- 
ment 'nver^oaTc ^eh, £££j£ffin^ our inventive circuit 600 shown in FIG. 6 and discussed in 
ably fabricated fr«r -JJ^^SS can be^mplememed through one or more genera, purpose microprocessors. 
t^ZZSZ^^S^^n 2* surtabty programmed to implement our present invention in soft- 
wTe!^^ ZZe Lro P rTessa(s) could execute instructs sufficiently fast to produce the requrste data 

,hr °f flowchart of our inventive multi-windowing thresholding method 200 is collectively depicted in FK3s. 2A 

and J B Tw^ch^rr^inment of the drawing sheets tor these figures is shown in FK3. 2. During the course of 
and 2B. tor wracni * j(| , De to FIGs . 3A . 3C where appropriate. 

drscussrngi method 200 eference wu i a ^so . an incoming j^ge. thereby Iterating through the 

• TS& the r£nZ rThCh S X^'e 'mage pixel is processed is identical across all such pixe,s. we 
'T ! v dlscussTws rouline ?n the context of processing generated pixelf..j). where i and j are posrhve .ntegers and 
^^Z£££Z** within the incoming gray-scale image. In addition to gray-scale .mage date. 

dd,nC ^eTvalu^ of Jo npt, parameters, specifically fixed thresholds IT and GT. These thresholds are adjusted. 
8 T ^ b Jot e^her to provide satisfactory thresholding across a multitude of differing .mages wrth vary.ng char- 
8 t J«1uch as'cS a P nd illumination, or can be adjusted to provide optimum thresholding for any one type of 
acter.st.cs. such as result of performing method 200 on all such gray-scale image p.xels. 

f ^ M ^nSSmage. Although not shown in FIGs. 2 A and 2B. Ha modrfied gray-scale .mage « to be Produced, 
to a p.xel m the ' ,n ^ m ' n9 » fesnion usj a 1ixed , pre-defined threshold, having a value IT. as that value 

ESEiET 25 - .in be further processed. e.g.. through scaling or filtering, as 

^rfpart--^^^ 
pixe.(ij).Th fe feaccon^.shed^y^e^ 
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ofGX(ij)andGY(ij): 

axClj)-MkiJ-i)*WJ)*M^li»l)-MhlW-»MP-lJ»-*lJ*l) (1) 



G(ij) = |GXf.j)|4|GY(i.D| (3) 



where: G(i.j) is the gradient strength at pixel position 

Jfitei* 'mage intensity, luminance. at pixel 
The ie S»r, strength va,ue tor every im. 9 e pixel collect^ terms a gradient streng. record for the entire 

~ On^gradient strength. Gfij). is determined tor pxe.f,D. ^™^he SSSSrtS 
period ^erminesthe area 5* window -.amatively 

and every pixel position within an (N-2)-by^N-2) w,ndow c^m^ea P n ,^ rative , y 7 -by-7, window shown in FIG. 
5 Jy" P 7xi in size and is shewn.; -£-££5 Sj) FcTplrp^s ot comparison, the periphery of ah N-by-N 

image. In this case, mewoc ' ^ gray-scale intensity of pixel ij). i.e.. , e here 

i black; otherwise, the p.xel is das ^'^^ 0 y^ 9 L ecisio ; wo* 2 15 advances method 200. along NO path 217. to 

a^nTry or^ay-scale output pixel. It Alternative* if a grayscale 

pai 225. toWocK 228 which, h turn, £ an J^J^SSK*. 224. to b,o* 230. This latter Ho*, when 
, output is desired, then decision "^^^^erelty d L* without any modifications made ftereto. J or .the 
oerlormed. sets the intensity of output P^^^^!2ihta*215 advances method 200. along YES path 218. to 

• 31 « "25525 SUV *. — - »» — ™» 

M MP 2« is no» pericn^ 10 ^^ESjS^otoW- an «v»ag.ptal Me™*, 
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70 



15 



20 



25 



30 



increase thresholding accuracy. equal to its associated average intensity value. 

,n particular. H gray-scale pixel '"tensrty. fc^"*M JJ"J£J t 7 decfeion block 260. This latter decision block 
. then decision block 251 advances method 200 .along NO path 254 » ^ay-scata output pixel. If a 

drtlrmLs whether a user has previou^y ££££ ££££££2 path 265. to Week 268 which, in turn, 
binary pxe. is desired, then dec^on b^^^ 

sets an intensrty of output p.xel(. j) to ttack. rero. However nsg y performed, determines whether 

advances method z00 -" a "° ^^51 J°hreshS vaSe rT H the Tn ensHy ollpfceKij) * less than or equal to threshold 
pixel intensity. L,. exceeds the V^«^*T™™ L"^275 which, when executed, sets the gray-scale output tor 
IT then method 200 advances, along NO patfi ^°J^ * 7 * £J D exceeds m value ot threshold IT, then method 
!U> - the Pixennten^ £^*£*££; sets me grayscale ou*ut lor pixeKiJ) to a 
200 advances, along t w t*»> • 

value that is slightly less. Le, IT-, than threshold in. jnlensity u thendecision block 

Alternatively, it ^"^^^^^St^^^^^SoSSo. This' decision bloc^determines whether 
251 advances method 200. atong YES path gray . sc8 , c output pixel. If a binary pixel is desired, 

a user has previously instructed the me ^°^^J^ 285 which, in turn, sets an intensity of output 

then decision block 280 advances the method, va JJ* J£n decision bio* 280 advances method 200. 
£S«D to white. i.e.. one. However rf pixe. intensity. U is less 

via NOpath284.too^iswnblcxk2M Th* ^ ' atte ^^ n ^f" P * ° ^ or fe equal to threshold IT. then method 200 
than pre-defined threshold value IT H the intensrty ^P^JJJ ~ ^ output for pixe.fr j) to the pixel 

advances, along NO path 292. to block 295 which ^exec^sete g ^ ^ ^ ^ Y£S ^ 
intensity value U- Now. if the intensity d p-xelOJ) .s J.^"^™ ' ^ « toa value that is slightly larger. L*. IT*. 
SUuock 297. which, when ~"*j£»< ' "STSSSSS less S respectively, threshold IT Is not critical 

r r^ii^-^ i^s « - — ^ ** ^ 4)1 ^ 200 te 

Shen'repeated for the next image pixel in ^^-J^^^ depicts intensrty profile 400 of an illustrative scan 
With this understanding rn rrund. consderF ^^^SSmS 10 shown in FK3. 1 . As a result of processing 
M of an original gray-scale |™ge^udi ^ *J^^K«>. ^wn in FIG. 5. results. As is readily apparent 
orofile 400 through our inventive method modified ,me ^P™ ^ xels located nee r an edge are modified, 

^comparing pro«iles400 its intensity is larger than threshold 
In this regard, when such a pixe is i located Im a darker s de « _ • e°9 ^ Alternatively, when an image 

value IT. the intensity of this pixel V^^^J^^^^ than threshold IT ; the intensity of this pixel is 

Thiser^-^^^ 

As shown, circuit 600 « formed of line ^J™*^™?^ 650 J*, 655 ; 7-by-7 Max and Min detector 635; 
gradient detedor 615; sum of ^^XS ^ of inverter 664. and gates 662. 670 and 
averaging circuit 640; r*^^^SSSSfc. F.Gs. 2A and 2B and discussed in detail above. 

, 675. Circuit 600 collect^ "f""*"^*" ££mi -outed in parallel, via leads 605 and 608. to an input of 
in operation. eight-bH input gray-scale magei ^<';» ou J , p 6l0 specifically series-connected single 
,ine deSys 610 and to an input of 7-by-7 Max and ^J^^lSSTpM abound image pixel(ij). 

ine delay elements 610,. 610 2 and 61 0 3 . provide a 8 ^ T^*^ Kne of the window. The outputs of all three 
Each d Jay element is tapped at three » SSTei? i-Neh. through calcutation of the Sobe. 

, delay elements are routed to respective inputs of gradient detect on j c output leads 617. This 

operator, as described above, provides an '^J^^^J^^^ sums a), the gradient intensity values 
gradient value is applied toaninput to ^J^^J^S^^ «m. as an area gradient value, i.e.. 
fn a 5-by5 window centered about pixel pos. .on (.J) and ijwdb This area gradient value 

5 is applied to an input ( A ) erf ' K5 «*j^ ^^»n»»rrtor. The resulting comparison output, appear.ng on 

theTatter being applied to another ^J^^^SSZt edge or not The comparison output is applied as an 

lead ■* as discussed in detaiI ^ - appropr,ate 
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£1^^^^^ Wrthm CUCUit ^ 

prroer^ynchronteation within circuit 600. threshold. GT, then the averaged intensity value. 

.1 the area gradient value. GS(i.j). exceeds the pre f^^XSmdSShi else. H the area gradient value te less 
L sed as attreshold levelin <^^J2Tft^K SSSSS*- In determining the value ot output 
«Z « eaual to the gradient threshold, then value IT is used as tne wves comparator 650. The current 

binary value tor pwelfij). To do «w > « .p. v ^ e sele ct signal, via lead 1 628. to a mb elect i»j 

spending eight-bit inputs to ^ ,ex ^''™X s ,ero ~T or -3". then the multiplexor will route center pixel value 
en anrisv H these signals assume the binary values aero, i or * res ponse to the comparison output 

sionals producea Dy cum v cnprHfcaUv H the area gradient is not larger man «■« rtlrtot it 

tour preceding conespond.ng 1-byJs «" °9J these del elemen ts connected ,n this tesh.on substan- 

Pift 8 decicts a block diagram ol 7-by-7 Maximum «. . inimum p j xe l intensity values. L^,, and 

0 FIG - tfr VL noted above, detector 635 determ.nes the maximum and minirnt , p separate 
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. echo ,hf,omthesameseriesofpixel^^ 
2 m nTh* * TZ I then readay appreciate how circuit 840 functions from th,s diso.ss.on. 
those sMIed , *e «£H W ^ ^ ^ max . )momdetector 810 j n adtfrtion. Ihe 

'"T'T^hfstx Hne delays 820 is routed over a different one of six feedback leads to a respective .nput of tti* 
hT! S£Z detector 810 extracts the maximum pixel intensity value from a 1*y-7 senescrf p«e. 

detector.^nsequent^ ^ |fl ^ 51X preced ng corre- 

As one can now appreciate, i n * ' JL D roperly classify image pixels located in the vicinity 
by the values defined tor^ 

of edges in an image. A relatrvely low GTva u« sienos ^ic ' «~ JJ? »^ that regard , a low IT value tends to classify 

classify pixels located in image 

pi*e.sofaunito^ 

purposes performs ; simBar to «J« » jnvention t0 classify pixels by essentially solely corn- 
will always be larger *han the ar« gradient M. aoy 9 ^ pro(juce an out , ine ^ rQogh 

the art 

j SIBlAI APPLICAR II ITY ANQ ADVANTAGES 
- present ^ t^ ^ 
eliminating boundary artifacts from a thresholded image. 



Claims 



A method ior 

method ">"<P"0« *" „. . „„,„„,., „, ptai values in me inpul imaoe. on area .radiant value lot a ftat 

contained within said second window, and . and minimum pixel values, a current one of 

position in the first output image. 

The method of claim 1 wherein the area ^ ( ^^ p ^ v ^'^^^^ and centered about 
measuring, in response to a third "^^^^T^JL for the cunent pixel poshfon such 

in,ensfty 9radient ~~ fe 

d- " nB iS 1B the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, determining said area gradient value. 

■n, c rhnd in claim 2 wherein said first window forming and area gradient determining step comprises the step of 
TuZ^S^ the intensity gradient values in said f irst window to produce the area gradient value. 
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5. 



6. 



7. 



8. 



Tne method tad*. 3 va.ue. GT, so as to produce 

input image lies in •^^^XSZX^ input pixel does not lie in the vicinity o. the edge. 

H the corrpa^n ^ ] ^^.^^^ p Z va P , ue a t position (i j) in the input image against 
f^lS *" Responding Knary output value at pixel position M 

* TtSSSSSi S- indicates that said one current input pixel does lie 

rt the compar *° a • , sakj cofresp0 nding binary output value to a first or.second state W 

SoXvater exceeds'or is .ess than an average o, the maximum and — pnce. values, 
respectively. 

• ..= imR a or 4 wherein said intensity gradient measuring step comprises the step of producing the 

« J=1 **" " *~ 

a Sobel operator. 

The method in Cairn 5 wherein the third window is a 3-by-3 window of input pixel values and the Sobel operator 
implements the following equations: 

GX(i j) = LChI + 2L(k1 j) + Ui+lj+D - - • MM 

GY (i j) = L0-1J+D + 2Uij+1) f Ui+lJ+1) - LO-1 - 2L<ij-1) - L0+1J-D: 

and 

G(ij) « |GX(i j)MGY(i.DI 

where: Lfl j) »s an input pixel value, in luminance, for 
the pixel position (i j) in the input image. 

^ "^^1522 and the pixel value (LJ at the current pixel portbn (i j) a 

producmg. in respons^ to s " , second image . wherein, if the comparison sjgnal 

modified gray-scale output pixel value at < P"W"W £ w . |n ^ - e ^ modified 

indicates that the one current input pixe does not be in v, " n ^ ™ signal indicat es that Ihe cunent 

gray-scale output pixel value • set ^\^^^^^^^A pixel value is set equal to a pre- 

d^rr/g^ 

second biC oSu. pixe. value at a pixel position (ij) within a second output image. 
Apparatus 1h,^ 

apparatus utilizes the steps recHed in any of clams 1-7. 



10 



EP 0 712 094 A2 




30 

i 





GREY SCALE 
IMAGE 


DIGITAL IMAGE 
PROCESSOR 

(THRESHOLDING & 

GREY SCALE 
MODIFICATION) 


33 


SCANNER 


DATA 


l 25 




5 

20 



37- 



BINARY 
IMAGE 



MODIFIED 
GREY SCALE 
IMAGE 



SIMPLE 

THRESHOLDING 
CIRCUIT 



T 

40 



BINARY 
-y~- IMAGE 
45 



FIG. 1 



EP 0 712 094 A2 



(g) 51 ART 



L 



GREY SCALE 
i IMAGE DAI A, L 



203- 



CALCULATE 
GRADIENT 
STRENGTH FOR 
PIXEL (i,j) 



206. 



CALCULATE THE 
SUM OF GRADIENT 
I STRENGTH (GS) 
IN (N-2) X (N-2) 
WINDOW CENTERED ON 
PIXEL 



DETECT Lmox 
ond L m in in 

N x N WINDOW 
CENTERED ABOUT 
PIXEL (i,j) 



230 
_1 



FIG. 2A 



SET 

INTENSITY Of OUTPUT 
PIXEL TO 
INTENSITY OF 
PIXEL IN CENTER 
OF WINDOW, Lc 



EXIT 





—245 




235 '» Sn 
s i INTENSITY 

• OF OUTFIT 

; PIXEL 

232 j TO 

237 — 1 WHITE 



G. 
6. 

72 



CALCULATE 

(L mox + Lmin ) 
Lovg = " — 



SET 

INTENSITY OF 
PIXEL TO 
! L C 



END 



~2<1 



246 



END 



12 



EP 0 712 094 A2 



FIG. 2B 





sn 


YES 


INTENSITY 




OF OUTPUT 


265 


PIXEL 


TO 


268 - 


BLACK 



SET INTENSITY 
OF OUTPUT 
PIXEL 0,0 
TO WHITE 



END 



SET INTENSITY 
OF OUTPUT 
PIXEL (i,j) 
TO Lc 




END 




297 — 



SH INTENSITY 
OF OUTPUT 
PIXEL (i,j) 
TO IT+ 




YES 


270 


274 — 


> 


SET INTENSITY 


OF OUTPUT 


PIXEL (i.i) 


TO IT- 





SET 




INTENSITY 


■ or OUTPUT 


PIXEL (i.i) 


TO L c 




I 

275 

1 


r 



END 



— 278 



END 



(^)END 



13 



V-CID: <EP 07I2094A2J.> 



EP 0 712 094 A2 



FIG. 3A 



N 



FIG. 3B 



(H) 


• 

I 

(r ») 


U "'J 


0-1) 

• 


0.0 


(HI) 

• 

1 


If!) 


• 




N 





0.i) 



310 



N 



N 



FIG. 3C 





N-2 




N-2 




























0.0 

































14 



EP 0 712 094 A2 




EP 0 712 094 A2 




16 



EP 0 712 094 A2 





18 



(19) 




(12) 



I^paischesPatentamt 1 1111111 itHUlll IllltllU 1111111111111 UU llfil lUBl\tlMWlll 

Euro pean Patent OHice 0 712 094 A3 

Office europeen des brevets \"l . 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

10.07.1996 Bulletin 1996/28 

(43) Date of publication A2: 

15.05.1996 Bulletin 1996/20 

(21) Application number: 95202928.8 

(22) Date of fifing: 30.10.1995 

(84) Designated Contracting States: 

DE FB GB IT 
(30) Priority: iai 1.1 994 US 338051 

ml ADDlicanr EASTMAN KODAK COMPANY 
(71> Bister, New York 14650-2201 (US) 

(72) Inventors: 

• Lee, Yongchun, 
r/n Eastman Kodak Co. 
Boeder, New York 14650-2201 (US) 



(51) lnt.a. 6 :G06T5/00 



CO 

< 

an 



Basile, Joseph M., 
c/o Eastman Kodak Co. 
Rochester, New York 14650-2201 (US) 
• Rudak, Peter, 
c/o Eastman Kod8k Co. 
Rochester, New York 14650-2201 (US) 

(74) Representative: Blickle, K, Werner, DipL-lng. et al 
KODAK AKTIENGESELLSCHAFT 
Patentabteilung 
70323 Stuttgart (DE) 



A mu ,t«-windowing technique for threshho.ding an image using .oca, image properties 



(54) 

(57) A technique, specifically apparatus and an 
i^mpanying method, for 

imase based on local image properties, speolcauy lurr* 
nTnce variations, and particularly such a technique «« 
us« multi-windowing for providing enr^nc^mmonrty 
to Saoe noise and lessened boundary artrtacts. Spec* 
EST! kSlired intensity gradient G(i j] L* deterrr»ned 
« a ore-defined window (300) centered about each 
n Localized minimum and maximum pixel 
image pixei(ij). LW ~'"~ , , eS nectivelv are also 
intensity measures. U*. and L™,. respeaiveiy aiea^ 

212mHM ^n^rfum o, irSividua. 

then classHied as being an object p.xel. ..e.. 

b^kground pixel. i.e.. white, based upon 

ent GS(ij). and associated I™ and i-mex measures. 




so 

JL 



DlCtlAl — 

proassot 

pHKSHDUftC * 
&RH SOU 



BINARY 



37— 



WODffYD 

cm sun 



cmcun 



T 



6IX4RT 



FIG. 1 



CM 



EP 0 712 094 A3 




Euiopean Pa^nt 
Office - 



EUROPEAN SEARCH REPORT 



AppSofion N»»k» 

EP 95 2G 2928 



^^ VnTC CONSIDERED T O BE RELEVANT 





